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Inspired by Minority Games, we constructed a novel individual-level game of 
adaptive decision-making based on the dilemma of deciding whether to partic- 
ipate in voluntary influenza vaccination programs. The proportion of the pop- 
ulation vaccinated (i.e., the vaccination coverage) determines epidemic severity. 
Above a critical vaccination coverage, epidemics are prevented; hence individ- 
uals find it unnecessary to vaccinate. The adaptive dynamics of the decisions 
directly affect influenza epidemiology and, conversely, influenza epidemiology 
strongly influences decision-making. This feedback mechanism creates a unique 
self-organized state where epidemics are prevented. This state is attracting, 
but unstable; thus epidemics are rarely prevented. This result implies that vac- 
cination will have to be mandatory if the public health objective is to prevent 
influenza epidemics. We investigated how collective behavior changes when pub- 
lic health programs are implemented. Surprisingly, programs requiring advance 
payment for several years of vaccination prevents severe epidemics, even with 
voluntary vaccination. Prevention is determined by the individuals' adaptabil- 
ity, memory, and number of pre-paid vaccinations. Notably, vaccinating families 
exacerbates and increases the frequency of severe epidemics, 
game theory | agent-based modeling | complex social dynamics | vaccines 
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Introduction 

Since the influenza vaccine is effective for one year, individuals must decide every year 
whether to participate in voluntary vaccination programs (jTJ). The proportion of the popu- 
lation vaccinated, p (i.e., the vaccination coverage) determines epidemic severity (J2J). Above 
a critical vaccination coverage p c , epidemics are prevented; hence individuals find it unnec- 
essary to vaccinate. Individuals that vaccinate protect themselves from infection. If they 
do not vaccinate they may still avoid infection if sufficient numbers of their peers vaccinate 
(i.e., through herd immunity). This poses a yearly dilemma (i.e., the vaccinee's dilemma) 
for the individual of whether vaccination is necessary. An individual's strategy for making 
yearly decisions may be an adaptive process of trial and error based on their decision making 
experience (i.e., using inductive reasoning). We model the adaptive dynamics of vaccination 
decisions in a population of non-communicating individuals acting in their own self-interest 
trying to avoid infection preferably without vaccinating. We track individual-level decisions 
and population- level variables; specifically, yearly vaccination coverage and prevalence / (i.e., 
the proportion of the population infected during an influenza season). We address the fol- 
lowing question: Can an ensemble of individuals self-organize to prevent influenza epidemics 
by yearly voluntary vaccination? 

Mean-field influenza transmission models (based on ordinary differential equations) have 
explored the epidemiological effects of treatment (JSJ), drug resistance multiple strains 
(J5J), and virulence (JHJ) at the population-level. Spatial data have been used to forecast in- 
fluenza epidemics (J7|), and investigate synchronization between epidemics dSJ). In the past 
decade, Minority Games © have attracted much attention in statistical mechanics and fi- 
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nance. Minority Games model the behavior of adaptive individuals within a collective that 
compete for the benefit of being in a minority. Inspired by Minority Games, we constructed 
an individual-level game of adaptive vaccination decision making. Our individual-level game 
includes the Susceptible-Infected-Recovered model (see Supplementary Methods Appendix 
A) to determined whether the critical vaccination coverage necessary to prevent influenza 
epidemics is likely to be reached. Previously, games have been used to price vaccines (fTUj) and 
predict voluntary vaccination coverage for pathogens that provide permanent immunity (e.g., 
smallpox or measles) (JTTJ). These games are based on deductive reasoning. For pathogens 
that provide permanent immunity, deductive reasoning can be used because individuals need 
to get vaccinated only once. In the case of influenza, individuals do not acquire permanent 
immunity and need to make vaccination decisions every year. Thus, it may be assumed that 
individuals make decisions based on their past experiences (i.e., use inductive reasoning) 
rather than based only on the current epidemiology (i.e., use deductive reasoning). In con- 
trast to previous work, our model is an inductive reasoning game. The central concept of 
our model is that the adaptive dynamics of the vaccination decisions directly affect influenza 
epidemiology and, conversely, influenza epidemiology strongly influences decision-making. 

Results 

We find that influenza epidemics cannot be prevented in most seasons if individuals make 
decisions based upon inductive reasoning and voluntary vaccination (Fig. 1A). When epi- 
demics occur, some individuals get infected and hence increase their vaccination probability 
for the next season; thus, p approaches p c (Fig. 1A). Eventually, the coverage slightly exceeds 
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p c due to the stochastic nature of the individual-level vaccination decisions and an epidemic 
is prevented. Next season, many individuals decide that there is no need for vaccination; 
thus p abruptly decreases and a severe epidemic ensues. (This effect resembles the occur- 
rence of crashes in financial markets ()19|) due to sudden loss of public confidence in the stock 
exchange.) Coverage then repeats similar dynamics (Fig. 1A). Yearly prevalence peaks every 
time coverage drops substantially below p c , rapidly decreasing in successive years as coverage 
increases (Fig. 1A). If initial coverage is larger than p c then p will drop below p c within a 
few years (results not shown). Coverage then follows similar dynamics to that illustrated 
in Fig. 1A. The feedback mechanism between the influenza epidemiology and the adaptive 
dynamics of the decision making creates a unique self-organized state where epidemics are 
prevented. This state is attracting, but unstable; thus epidemics are rarely prevented. This 
result implies that vaccination will have to be mandatory if the public health objective is 
to prevent influenza epidemics. In the Supplementary Methods, we show the fixed point 
analysis and derive the expected periodicity of the coverage dynamics. 

The dynamics of each individual's vaccination probability is more complex than coverage 
dynamics (Fig. IB). Figure 1C shows two distributions for the individual's probabilities of 
vaccination w^>. The first distribution (black) is obtained when epidemics are prevented. 
Individuals segregate into two groups as found for other inductive reasoning games (|T2|). 
Individuals in one group are very likely to vaccinate whilst individuals in the other group are 
very likely not to vaccinate, few are undecided. The second distribution (blue) is obtained 
in the successive seasons when severe epidemics occur. In these seasons, the distribution 
of the vaccination probabilities remains segregated. However, individuals who were very 



5 



likely to vaccinate decrease their vaccination probability (Fig. 1C) causing severe epidemics. 
As p increases back to p c , the second distribution (blue) slowly tends towards the first 
distribution (black). Eventually, p again exceeds p c and the distribution undergoes a similar 
cyclic dynamics. 

We then investigated how collective behavior changes if certain public health programs 
are implemented, but vaccination remains voluntary. Specifically, we focused on whether 
either of two programs (based upon incentives) would prevent influenza epidemics. For the 
first program we assumed that if the head of the family pays for his/her vaccination, then 
their family would get vaccinated for free. The head of the family uses inductive reasoning to 
make decisions and modifies his/her probability of vaccinating next season depending upon 
the number of family members that were infected. Surprisingly, this program exacerbated 
epidemics and also increased the frequency of severe epidemics, even with voluntary vaccina- 
tion. Coverage dynamics appear similar to the original dynamics with no program; Fig. 2A. 
However, p dropped more frequently below p c and thus more severe epidemics occurred; the 
time average of the coverage (p) is lower than in the absence of the program. This program 
exacerbated epidemics because it reduced the number of independent decision makers; see 
Supplementary Methods for details. 

For the second public health program we assumed that free vaccination would be offered 
for y number of successive years if the individual paid for vaccination in the first year, and 
that individuals who participate in the program take the offer of free vaccination for all y 
successive years. Individuals do not make decisions during the years of free vaccination, 
but they still evaluate the necessity of vaccination. They then use their evaluations to 
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decide whether to pay for a subsequent vaccination and receive a further y free vaccinations. 
This program (even though it is based upon voluntary vaccination) could greatly ameliorate 
epidemics. Amelioration depend upon the: memory parameter s, adaptability parameter e, 
and number of years of free vaccination y. Figure 2B shows coverage dynamics for y = 3 years 
(red - the epidemic is ameliorated) and y = 15 years (green - the epidemic is exacerbated); 
y = (black) is shown for comparison. For y = 3 years (p) increases; epidemics are much 
less severe but more frequent than for y = years. Furthermore, the average prevalence (/) 
is substantially lower than for y = years. For y = 15 years epidemics occur with greater 
severity; moreover average prevalence for y — 15 years is greater than for y — years. 
Epidemics were prevented most seasons because average coverage (p) exceeded the critical 
coverage p c . Figure 3 shows the parameter regions for memory s and adaptability e that are 
important for increasing (p) and decreasing (/). When y = 0, epidemics were ameliorated if 
the population was composed of individuals who readily adapted their decisions and/or who 
did not quickly forget their past vaccination experience (Figs. 3Ai and 3Aii). The situation is 
more complex when y > 0; there are disconnected areas in the (e, s) parameter space where 
the program can exacerbate epidemics; Fig. 3. 

Discussion 

In the United States (US), demand for influenza vaccines is generally met and no major 
shortages occur. In recent years, coverage (based upon voluntary vaccination) has steadily 
increased (fT3~l Hlj) . One of the national health objectives of the US is to increase the coverage 
()13| ITlj) that is currently below the Healthy People 2010 objectives (J15J) . We found com- 
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plex epidemic dynamics can occur simply due to individuals making voluntary vaccination 
decisions. We deliberately did not include variation in strain virulence because we wanted 
to assess the impact of voluntary vaccination on pathogen dynamics. Notably, we found 
large influenza epidemics could occur without the introduction of virulent pandemic strains. 
Furthermore, the critical coverage level is unlikely to be reached if vaccination is voluntary. 
We also found that certain public health programs could be detrimental. Previous studies 
have shown that vaccinating above the critical coverage level would always be worthwhile. In 
contrast, we paradoxically found that a coverage level higher than the critical level could be 
problematic. This perverse result occurs because inductively reasoning individuals evaluate 
vaccination as unnecessary if the critical coverage level was exceeded in the previous season. 
The severity of the subsequent influenza epidemic depends upon the degree to which the 
critical coverage was exceeded. 

We used a novel individual-level inductive reasoning game model to obtain insight into 
the impact of individual-level vaccination decisions on influenza epidemiology. We found that 
critical vaccination coverage levels will rarely be reached; hence influenza epidemics will only 
occasionally be prevented. This result implies that vaccination will have to be mandatory if 
the public health objective is to prevent influenza epidemics. The two central assumptions 
of our model are that individuals do not communicate their vaccination decisions and act in 
their own self-interest. If other assumptions are made then other outcomes are possible. If 
a herding mechanism (|16J) occurs where individuals share their perception of risk of getting 
infected, then the public may vaccinate even if when it does not appear worthwhile for them; 
this behavior may prevent epidemics. However, even if individuals act in the interest of their 
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own families epidemics would not be prevented if vaccination is voluntary. In contrast, public 
health programs, based on pre-payment, could greatly ameliorate influenza epidemics. 

Methods 

In the past decade, inductive reasoning systems have been modeled using Minority Games 
(0 ITT)) . A Minority Game models how non-communicating selfish individuals reach collective 
behavior with respect to a common dilemma under adaptation of each one's expectations (jnj). 
Minority Games have been used to model financial markets ()18|) . Here we present the first 
vaccination decision model based on Minority Game methodology. We model a population 
of N individuals acting in their own self-interest that do not communicate their vaccination 
decisions with each other. Every year, these individuals independently decide whether or 
not to vaccinate against influenza. Individuals use their past experiences to help them make 
their vaccination decisions for the current season. The probability that individual % chooses 
to vaccinate in season n is Wn . Individual i is assigned a variable vjf* the value of which 
depends upon whether or not: the individual choses to vaccinate, they became infected, and 
an epidemic occurred (Fig. 4A). Vn increases each time the individual perceives that there 
was, or would have been, a benefit to vaccination because (a) the individual vaccinated and 
there was an epidemic, or (b) the individual did not vaccinate and then became infected 
(Fig. 4A). 

We model the effect of memory by using a parameter s to discount the previous sea- 
sons' vaccination outcome with respect to the outcome of the present season (0 < s < 1). 
Specifically, V^+ x = sVn + 1 if individual % believes he did, or would have, benefited from 

9 



vaccination in season n. Otherwise, if individual i believes that vaccination was unnecessary 
in season n (regardless of whether he got vaccinated or not), V^+i = sVn \ We normalize 
Vn+i by (s n+1 — l)/(s — 1) because this factor is the maximum possible value for V^li if 
individual i would have benefited from vaccination in all n influenza seasons. The domain 
for is < < 1/(1 — s). The probability that an individual chooses to vaccinate in 
the next influenza season is given by u^+i = (1 — e)^n + el^^ 1 /[(s n+1 — \)/{s — 1)], where 
e describes the adaptability with respect to experience with vaccination (0 < e < 1). 

In our model, the probability of an unvaccinated individual acquiring influenza q(p) 
decreases linearly as the coverage p increases; Fig. 4B. When p > p c the probability of an 
unvaccinated individual getting infected is defined to be zero. This linear function is a good 
approximation of the relationship found for the Susceptible-Infected-Recovered model; see 
Supplementary Methods Appendix A. Our model describes a large population of individuals. 
Thus, we account only for epidemics and we do not consider outbreaks. Outbreaks become 
decreasingly important as the population size N increases. Although we do not include the 
option of treatment, the effects of treatment can be implicitly accounted in our model by 
decreasing p c . 

At the end of the season, each individual evaluates their vaccination decisions based 
upon whether vaccination was necessary to avoid infection. Consequently, they modify their 
probability to vaccinate next season to w^ +1 . Figure 4A shows a diagram of the evaluation 
tree. Individuals start their first season with no prior experience in decision making as 
whether to vaccinate or not. The initial condition assigns a random vaccination probability 
for the first season to every individual. Specifically, Vq = and = U[0, 1) for all 
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individuals where U[0, 1) is a uniformly random variable between and 1. Our initial 
conditions are chosen to reflect the fact that the initial public awareness of the benefits 
of influenza vaccination would not be high enough to prevent an epidemic, while at the 
individual-level, the likelihood of vaccination may vary considerably. 

For the case of the first public health program, based upon voluntary vaccination, we con- 
sidered a population of N individuals that are grouped into families with C members. The 
head of the family updates his/her Vn value (where j labels the family, i.e., j = 1...N/C) 
in the following way: (a) = sVn + C if the head of the family had decided to vaccinate 
his/her family and there was an epidemic that season; (b) V^i — sVn if there was no epi- 
demic that season, regardless of whether or not the family was vaccinated against influenza; 
(c) = sVn^ + k if k members of the family were infected in a season where the head of the 
family decided not to vaccinate his/her family. We normalized the value of V^X by a factor of 
C(s n+1 — l)/(s — 1) that represents the maximum possible value of V^_\. Therefore, the vac- 
cination probabilities are updated as follows itf^+i = (1 — e)wn ^ + ^V^ 1 /[C(s n+1 — l)/(s— 1)]. 

The authors gratefully acknowledge financial support from NIH/NIAID (ROl AI041935). 
We also thank Nelson Freimer, Tara Martin, Justin Okano, and David Wilson for discussions 
during the course of this research. 

Supplementary Information accompanies the paper. 
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Figure 1: Vaccination dynamics using a memory parameter s = 0.7, an adaptability pa- 
rameter e = 1, a critical coverage p c = 0.6 (dashed line) and a probability q(0) = 0.8 of 
getting infected when p = 0. A: Dynamics of yearly coverage p for a population of N = 10 5 
individuals (black), and the corresponding dynamics of the prevalence / (red). The dynam- 
ics of p is approximately cyclic: as p approaches p c from below, eventually fluctuates above 
p Cj and then abruptly drops. B: Wn versus time for two individuals in the population. In 
contrast to the simple dynamics of the coverage, individuals go through complex decision 
behavior. C: Normalized distributions p(w®) of Wn for a population of N = 10 7 individuals. 
The distribution when the coverage fluctuates above p c is shown in black and the successive 
distribution when the coverage abruptly drops below p c is shown in blue. Individuals tend 
to strongly segregate into two groups. The individuals in the first group are highly likely 
not to vaccinate next season. In the black distribution, the individuals in the second group 
are highly likely to vaccinate (i.e., w — 1). In the blue distribution the individuals in the 
second group are less likely to vaccinate than previously (i.e., w — s, given that no epidemic 
occurred in the previous season). 
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Figure 2: Coverage dynamics for different public heath programs (that are based on voluntary 
vaccination) in a population of N = 10 5 individuals using a memory parameter s = 0.7, an 
adaptability parameter e = 1, a critical coverage p c = 0.6, and a probability q(0) = 0.8 of 
getting infected when p = 0. A: The head of the family makes the decision as to whether 
or not their family vaccinates. The coverage dynamics when the family size is eight (C = 
8) is shown in blue; the coverage dynamics when individuals make vaccination decisions 
independently is shown in black for comparison. Similar results were obtained for family 
sizes of two and four. B: Individuals that pay for one vaccination are rewarded with y = 3 
(red) and y = 15 (green) extra years of vaccination; the coverage dynamics when individuals 
pay for every year of vaccination is shown in black for comparison. 



Figure 3: Structure of the average prevalence (/) (panels i) and the average coverage (p) 
(panels ii) in the parameter space (e, s). A: no public health program - i.e., y = (gray 
scale). B: Individuals that pay for one vaccination are rewarded with y = 3 extra years 
of vaccination (red scale). C: Individuals that pay for one vaccination are rewarded with 
y = 15 extra years of vaccination (green scale). 
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Figure 4: A: Diagram illustrating the evaluation tree. An individual that decides to vaccinate 
(branch (a)) will judge their decision depending on whether there was an influenza epidemic 
that season. If p > p c (branch (al)), they will conclude that getting vaccinated that season 
was not necessary to prevent infection. Otherwise, if p < p c (branch (a2)), they will conclude 
that their decision was beneficial for avoiding infection that season. An individual that 
decides not to vaccinate that season (branch (b)) will judge their decision based on whether 
or not they were infected. If they did get infected (branch (bl)) they will conclude that their 
decision of not vaccinating was detrimental and that vaccination was necessary for avoiding 
infection. Instead, if by chance they avoided infection (branch (b2)), they will conclude that 
vaccination was not necessary. B: The probability of getting infected with influenza q(p) 
versus the vaccination coverage p. 
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